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[57] ABSTRACT 

A data compression system 200, method, and apparatus 214 
employs an encoder 210 optimized to decorrelate and make 
independent from the original signal 202, the quantization 
noise produced during signal compression. The proposed 
system 200, method, and apparatus 214 supports high 
degrees of signal compression, which in turn leads to lower 
computational complexity and improved performance. 
Because the quantization noise produced during signal com- 
pression is made independent from and non-orthogonal (i.e., 
uncorrected) to the original signal 202, enhanced filtering is 
achievable, which in turn leads to improvements in the 
signal-to-noise ratio (SNR) of the decoder 220. 

39 Claims, 12 Drawing Sheets 
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DATA COMPRESSION SYSTEM, METHOD, FIG. 8 is a functional block diagram of the predictor 

AND APPARATUS circuit as taught in accordance with FIGS. 6 and 7. 

FIG. 9 is a block diagram of a communications device of 

CROSS REFERENCE TO RELATED me type anticipated for use by the present invention. 

APPLICATIONS 5 pIG. 10 is a flow chart diagram depicting the steps 

This application is related to U.S. application Docket No. performed by the device of FIG. 9 employing the compres- 

CM02286J, by Yolanda Prieto, entitled "Adaptive Filtering sion methodology of the present invention, 

for Use with Data Compression and Signal Reconstruction," FIG. 11 is a flow chart diagram depicting the steps 

filed concurrently herewith, and assigned to Motorola, Inc. ^ involved with filtering noise in accordance with the present 

invention. 

TECHNICAL HELD FI(J 12 is a pictorial representation depicting original 

This invention relates in general to data compression and image reconstruction in accordance with the prior art. 

particularly to digital data compression. Specifically, the FIG. 13 is a pictorial representation depicting original 

invention relates to a method, and apparatus that provides 15 image reconstruction in accordance with the present inven- 

adaptive filtering in digital data compression system, such tion. 

as, for example, slow rate video processing and other data FIG. 14 is a functional block diagram of an embodiment 

compression applications. of the fiUer of the present invention . 

BACKGROUND 20 DETAILED DESCRIPTION OF THE 

. With the advent of technologies and services related to PREFERRED EMBODIMENT 

teleconferencing and digital image storage, considerable WMle the specmcation concludes with claims defining the 

progress has been made in the field of image processing. As features of the invention that are regarded as novel, it is 

will be appreciated by those skilled in the art, image believed that the invention will be better understood from a 

processing typically relates to systems, devices, and meth- consideration of the following description in conjunction 

odologies for generating image signal data, compressing the ^ the drawin fi ^ which ^ refereoce numerals 

image signal data for storage and/or transmission, and are carried forwafd For the sake of dafi ^ m 

thereafter reconstructing the original image from the com- discussion relates t0 a data proC essing system, method, and 

pressed image signal data. Critical to any highly efficient, apparatus mat lo ^ cncodcr optimized to decorTe l a t c 

cost effective image processing system is the methodology and make inde endent from an ori mal si ^ the quanti . 

used for achievmg compression. zatkm ooise produced during signal compression. The pro- 

As is known in the art, image compression refers to the posed methodology supports high degrees of signal 
steps performed to map an original image into a bit stream compression, which in turn leads to lower computational 
suitable for communication over a channel or storage in a 35 complexity and improved performance (i.e., reduced delay), 
suitable medium. Methodologies capable of minimizing the Because the quantization noise produced during signal corn- 
amount of information necessary to represent and recover an pression is made non-linearly independent from and 
original image are desirable in order to lower computational orthogonal (i.e., uncorrelated) to the original signal, 
complexity and cost. In addition to cost, methodologies enhanced filtering techniques are required, which in turn 
capable of providing high quality image reproduction with 4Q will lead to improved signal-to-noise ratios (SNR) when 
minimal delay are likewise desirable. compared to the known art. The present invention, therefore, 

Due to the enormous growth potential of businesses is a method and apparatus for filtering data signals to remove 

relying on these techniques, considerable work and effort independent and uncorrelated noise generated during data 

has been conducted in this area. Despite these efforts, there compression. 

still remains a need for an improved image processing 45 Referring now to FIG. 1, a partial block diagram of a 

method, system, and apparatus that operates to reduce the known data communications system 100 is shown. As will 

noise generated during image signal compression be appreciated, the communication system 100 depicts an 

(quantization noise), improve the achievable signal to noise encoder 110 coupled to a decoder 120 across a channel 130. 

ratio (quality) during image reconstruction, while avoiding Both the encoder 110 and the decoder 120 employ com- 

the lengthy delays typically associated with prior art 50 pression. As is known, compression attempts to map an 

approaches. original signal into a bit stream suitable for communication 

BRIEF DESCRIPTION OF THE DRAWINGS include a wireless> wire line, acoustic, or optically linked 

FIG. 1 is a partial block diagram of an image processing transmission path such as, for example, a radio frequency 

system known in the art. 55 (RF) or fiber optic transmission path. The channel 130 may 

FIG. 2 is a block diagram of the image processing system likewise be a storage medium such as those now known or 

of the present invention ^ ater developed. Central to all systems of compression is the 

rrwr~< a- u - , r iL i- r desire to reduce the number of bits required to represent and 

FIG. 3 is a graphical representation of the application of subse ^ fe ^ an ori inal • ^ 

an image signal to the wavelet transform of FIG. 2. su sequen y repro ce an ongina sign 

CTO A . . . . , 4 . c . . , . 60 Since the communication system 100 of FIG. 1 is well 

FIG. 4 is a pictorial representation of an original image. , . . , , •« . m j . 

___ m . *\ „ , ^ . . & known, minimal explanation will be provided at this tune. 

FIG. 5 is a pictorial representation of the application of The inlerested reader may nevertheless refer to P. C. 

the image of FIG. 4 to the wavelet transform of FIG. 2. Cosman, R. M. Gray, and M. Viterlli, "Vector quantization 

FIG. 6 is detailed block diagram of a first embodiment of 0 f image subbands: A survey " IEEE Transactions on Image 

the quantizer circuit of FIG. 2. 6S Processing, vol. 5, no. 8, pp. 202-225, February 1996, for a 

FIG. 7 is detailed block diagram of a second embodiment more detailed discussion. Suffice it to say, however, the input 

of the quantizer circuit of FIG. 2. 102 to system 100 is usually a sampled analog signal. When 
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the input 102 represents an image signal, the samples s(n) bit/sample resolution. The wavelet transform stage 212 
e.g., pixels, typically have a resolution of 8-12 bits per produces a output comprising subband selected vector coef- 
sample. The encoder 110 operates to reduce the number of ficients of the image signal, as discussed further in associa- 
bits per sample required to represent the sampled signal and tion with FIG. 3. Referring back to FIG. 2, wavelet trans- 
meet the channel capacity requirements. 5 form stage 212 is coupled to a quantization encoder 214 to 
In operation, encoder 110 employs a decomposition communicate the wavelet transformed version of the 
encoder, such as, for example, a frequency domain encoder. sampled input signals to the quantizer encoder 214 for 
Such an encoder, having M parallel subband filters 112 father compression. 

covering the complete frequency bandwidth of the input As will be appreciated by those skilled in the art, after 

signal 102, will encode each frequency band with a coder 10 further review hereof, quantization encoder 214 employs 

and at a bit rate matched to the statistics and relative first and second quantization stages in order to compress the 

perceptual importance of the particular frequency band in wavelet transformed signal received from wavelet transform 

question. As will be appreciated by those skilled in the art, stage 212. As will be discussed in detail in association with 

frequency domain encoding techniques offer the advantage FIG. 4, the first quantization stage compresses the wavelet 

that the number of bits used to encode each band can be 15 transformed signal and produces compression/quantization 

variable, such that bands with little or no energy may not noise components, correlated to an non-linearly dependent 

require encoding, resulting in improved compression. This upon the input signal 202. The second quantization stage 

methodology is frequently referred to as subband encoding. compresses an error signal difference between the wavelet 

Each subband filter 112 output is subsequently quantized transformed signal and an estimate of the quantization noise 

(compressed) and coded by encoder 114 at a bit rate selected 20 components to produce noise components independent from 

to reduce the number of bits required to represent each the image signal. The purpose of isolating such noise 

sample. There are several algorithms that may be used to components; namely, those independent from the image 

achieve compression of an original signal. The most elemen- signal, is to pursue aggressive filtering techniques that 

tary methods quantize each signal sample into one of a small improve reconstructed signal quality, without negatively 

number of levels, each one thereafter being represented by 25 impacting the desired image signal components. This is 

a channel symbol from a global code book. As will be especially important when short vector lengths and small 

appreciated, a channel symbol need be nothing more than an code books are employed during image reconstruction, 

index or pointer into the location of centroids within a code The quantizer 214 output will be represented by channel 

book. A well-known quantizer is the Lloyd-Max optimal symbols or centroids maintained in code book 215. In 

quantizer using nearest neighbor, minimum squared error 30 accordance with the preferred embodiment, each centroid 

(MSE) rules to classify an input into a specified number of contained within code book 215 is assigned a binary index 

levels. Assuming the original signal is an image signal, the 216. The index is what is communicated over or stored to 

typical bit rate of an image with acceptable quality when channel 230. As previously discussed, the channel 230 may 

compressed in this way is about 0.4 bits/pixel. include a wireless, wireline, acoustic, or optically linked 

At the receiving end, decoder 120 will reconstruct the 35 P atn such as, for example, a radio frequency (RF) or fiber 

original signal. In accordance, decoder 120 has its own code optic transmission path. The channel 230 may likewise be a 

book 124, identical to the code book of encoder 110. storage medium such as those now known or later devel- 

Assuming the encoder index is communicated across the oped. 

channel 140, the decoder 120 can retrieve respective channel 4Q At the receiving end, decoder 220 employs a code book 

symbols and/or code-vectors by merely indexing the code 225 and table lookup 224 to retrieve previously stored (i.e., 

book 124 lookup with a received index. Thereafter, a syn- trained) centroid information by indexing the table lookup 

thesis filter bank made up of filters 122 receives upsampled- 224 with received index information 216 to retrieve infor- 

by-M or interpolated subband signals in order to reconstruc- mation stored in code book 225. As will be appreciated by 

tion the original image samples s'(n). In the absence of 45 those skilled in the art, the system 200 is most efficient when 

quantization, the filters 112 and 122 are interdependent and code book 225 content is identical to the code book 215 

designed in such a way as to permit perfect reconstruction of content. Under the circumstance where a single device will 

the original image 102. transmit and receive information utilizing system 200, the 

Again, a fundamental advantage of subband coding for device code book is trained by quantization those images of 

data compression is that it transforms the signal into a 50 interests. Upon completion, a single code book for use 

domain which typically provides unequal energy patterns at during transmission and reception of data is available, 

the different subbands. This pattern may therefore be The indexed output of table lookup 234 is communicated 

exploited to select the optimum coding algorithm which to an adaptive filter 223 which filters the code book output 

controls the bit allocation among the subbands, according to to remove unwanted noise. Thereafter, an inverse wavelet 

its energy or perceptual importance. In accordance, sub- 55 transform stage 222 operates upon the filtered signal to 

bands with little energy may not be coded at all, resulting in reconstruct the original signal samples s'(n). While the 

immediate compression. Another advantage is that quanti- preferred embodiment suggests filtering the table lookup 

zation noise in a particular subband is limited largely to the 224 output, it will be appreciated by those skilled in the art, 

band of interest, and will not therefore spill over to the other after review hereof, that adaptive filtering, as described 

bands. 60 herein in greater detail in association with FIG. 11, may 

FIG. 2 is a partial block diagram of a data communica- alternatively be performed after the inverse wavelet trans- 

tions system anticipated by the present invention. In accor- formation stage 222 or after the quantization stage 214 

dance with the preferred embodiment, the communication without departing from the spirit of the present invention, 

system 200 of FIG. 2 is an image processing system. As While the suggested decomposition encoder 212 is a 

depicted, the decomposition encoder 212 is a multilevel 65 wavelet transform stage, it will be appreciated by those 

wavelet transform stage that receives the input signal 202, a skilled in the art that other frequency domain encoders now 

sampled image signal wherein each pixel has an 8-12 know or later developed may be substituted therefore to 
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achieve acceptable performance. Well known frequency 
domain encoding techniques include, but are not limited to, 
fast Fourier transform (FFT), discrete cosine transform 
(DCT), discrete sine transform (DST), discrete Karbunen- 
Loeve transform (KLT), discrete Walsh-Hadamard trans- 5 
form (WHT), wavelet transforms (WT), and combinations 
thereof. 

Prior to vector quantizing the wavelet transformed version 
of the sampled input signal, the signal must be arranged in 
vector form as depicted in FIG. 3. Starting with the subbands 1Q 
for the three level wavelet transform, the process is 
described as follows. Assume the original image as shown in 
FIG. 4 is 256 by 256 pixels. The subbands associated 
therewith shall be labeled BXOO, BX01, BX10 and BX11, 
where X=l, 2, or 3. With reference to FIG. 3 it will be 
appreciated that band B100 is decomposed into four bands 15 
B200, B201, B210, and B211. Band B200 is further decom- 
posed into four bands, bands B300, B301, B310, and B311. 
From the corresponding each level of bands can be blocked 
into corresponding square blocks such that there is an equal 
number of blocks for each level of bands. This makes the 20 
block size reduce geometrically by Vz from the previous 
level, until the last band is blocked in pixels of 1 by 1 pixel 
size. 

For a level L wavelet transform, there are 3L+1 subbands. 
In accordance with the present example, there are therefore 25 
10 subbands. In the current example where the original 
image of FIG. 4 is 256 by 256 pixels, band Bl is 128 by 128 
pixels, band B2 is of 64 by 64 pixels, while band B3 is 32 
by 32 pixels. For L-3, the respective block sizes per band 
are 4x4, 2x2, and lxl respectively. This structure is more 30 
clearly observed with reference to FIG. 5, which is a 
pictorial representation of the output of the wavelet trans- 
form upon receipt of the original image of FIG. 4. While the 
present embodiment is a 3 level wavelet transform, it will be 
appreciated by those skilled in the art that a number of levels 35 
less than 3 or greater than 3 can be employed by such a 
wavelet transform stage. 

FIG. 6 is detailed block diagram of one embodiment of 
the quantizer circuit 214 of FIG. 2. As will be appreciated, 
the quantizer circuit of the present invention comprises a 40 
first vector quantization compressor 600, coupled to the 
wavelet transform 212 of FIG. 2, for quantizing i.e., com- 
pressing the data components received from the wavelet 
transform 212. In accordance with the preferred 
embodiment, the first quantization compressor 600 adap- 45 
tively sizes groups of image vectors presented by the wave- 
let transform 212 and quantizes the image vectors within 
each group to establish a centroid for each group. The output 
from the first vector quantization compressor 600 is a signal 
comprised in part of quantization noise components corre- 50 
lated to and dependent upon the image signal and com- 
pressed vector coefficients. It will be appreciated by those 
skilled in the art that since the wavelet transform 212 of FIG. 
2 performs subband transformation on some, but not nec- 
essarily all of the subbands of the input signal 202, quanti- 55 
zatioo compressor 600 likewise performs subband compres- 
sion on some but not necessarily all input signal subbands. 
In fact, the system of the present invention is advantageously 
optimized to operate on subbands according to their energy 
level or perceptual importance to the original data or image so 
400 of FIG. 4. 

As previously mentioned, the first and second quantiza- 
tion compressors 600 and 606 are Lloyd-Max quantizers. 
Notwithstanding, the preferred embodiment, other quanti- 
zation compressors may be substituted therefore; namely, 65 
vector quantizers, scalar quantizers, trellis quantizers, and 
mean-squared -error quantizers, just to name a few. 
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Continuing, a predictor circuit 602 is coupled to the 
quantizer 600 output 603. The predictor 602 operates to 
estimate, predict, or determine the quantization noise as 
generated by the first quantization compressor 600. This 
output 603, approximates the noise generated by the quan- 
tization compressor 600. Because it is an estimate, as 
determined by vector predictor 604, it will not typically 
share a phase relationship or correlation to the input signal 
202 of FIG. 2, and may therefore be used as the uncorrelated 
noise component of the quantizer 600. In effect, predictor 
602 operates to decorrelate the noise generated by quantizer 
600 from the input signal 202 of FIG. 2. 

For a detailed block diagram of vector predictor 604, the 
interested reader may refer to FIG. 8. Vector predictor 604 
employs a gain-plus-additive-noise model which operates as 
follows: 

Y=Q[x}°X+E~AX+R 1) 

where X is the data signal, Y is the quantized data signal, 
E is correlated quantized noise, R is uncorrelated 
quantized noise, and A is a prediction matrix. 

The optimal value of the predictor matrix is: 

A~(YX r )Qa r )- i 2) 

To recover X multiply by the inverse of A: 

A^Y-X+A^R^X+N 3) 

where N is uncorrelated with X, albeit non-linearly depen- 
dent on the input signal. 
The error is determined as: 

E*<A-r)X+AN=(A-!)X+R 4) 

Referring back to FIG. 6 the vector predictor 604 output; 
namely, the uncorrelated quantization noise components, are 
summed at summing junction 605 with the transformed 
output of the transform 212 of FIG. 2 to produce an error 
signal. Likewise, when the input signal is an image, it will 
be appreciate by those skilled in the art that the estimate 
signal generated by vector predictor 604 when summed with 
the plurality of image vector coefficients provided by the 
wavelet transform 212 of FIG. 2 will combine to generate an 
error signal. A second Lloyd-Max quantization compression 
stage 606 is coupled to the summing junction 605 for 
quantizing the error signal as generated by the summer 605 
to generate a quantized error signal. Thereafter, the summing 
circuit 607 operates to sum the quantized error signal and the 
estimated signal to generate an output comprised in part of 
signal independent noise components that are uncorrelated 
to the input signal and code book content; namely centroids. 

In accordance with the present invention, each centered as 
determined during data encoding is assigned a binary index. 
This index is typically what is communicated from the 
encoder 210 to the decoder 220 of FIG. 2. Because the 
decoder 220 has a code book 225 typically identical to the 
code book 215 employed by the encoder 210, the centroid 
values can be retrieved by means of indexing lookup table 
224 via the received binary index. As will be appreciated by 
those skilled in the art, it is more economical and less 
complex to communicate an index 216 as opposed to actual 
centroid coefficients. 

One of the more critical steps in vector quantization is the 
design of the code book, such that the operation of the 
decoder 220 is completely described once the code book is 
specified. Typically, the set of quantizer outputs describe the 
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code book and the process of placing these outputs is is a multilevel wavelet transform which decomposes the 

referred to as code book design. In accordance with the input signal into a set of sub-images with different resolu- 

preferred embodiment, code book design employs the Linde, tions corresponding to different frequency bands (refer to 

Buzo, and Gray algorithm, commonly referred to as the FIG. 5). The resulting image coefficients are then vector 

LBG algorithm. For additional details, the interested reader 5 quantized (compressed) at block 1008 using a mean square 

is referred to Y. Linde, A. Buzo, and R. M. Gray, "An error (MSE) tolerance as set at block 1006. The MSE 

algorithm for vector quantizer design" IEEE Trans. Comm., tolerance in accordance with the present invention is adap- 

yol. COMM-28, pp. 84-95, 1980. tive (i.e., adjustable) such that the size of the groups of 

FIG. 7 is a detailed block diagram of a second embodi- image coefficients around which respective centroids are 

ment of the quantizer circuit 214 of FIG. 2. As will be id calculated and across which the mean square error tolerance 

appreciated after literal comparison, the circuits are virtually is exercised may be sized in order to improve image recon- 

identical. Due to the close similarity, only the differences struction time, reduce image reconstruction cost, or enhance 

will be discussed at this time. With reference to FIG. 7, an image reconstruction quality. 

inverse wavelet transform stage 702 is employed at the From block 1008 flow proceeds to block 1010 where the 

output of vector predictor 604. The inverse wavelet trans- 15 vector predictor of 604 of FIG. 6 determines a prediction 

form stage 702 operates to convert the vector predictor error matrix as a function of the compression noise generated by 

estimate into an estimate image signal. Thereafter, the the quantization compressor 600 of FIG. 6. In accordance 

estimate image signal is summed at summing junction 605 with the preferred embodiment, vector predictor 604 utilizes 

with image signal 202 to produce an image error signal. The a gain-plus-additive-noise model further described by Y«X+ 

second Lloyd-Max quantization compression stage 606 is 20 E-AX+R, where X is the input signal, Y is the quantized 

coupled to the summing junction 605 for quantizing the input signal, E is correlated quantized noise, R is uncorre- 

image error signal as generated by the summer 605 to lated quantized noise, and A is a prediction matrix. From 

generate a quantized image error signal. Thereafter, the block 1010, flow proceeds to block 1012, where the vector 

summing circuit 607 operates to sum the quantized image predictor 604 applies the prediction matrix to the centroid of 

error signal and the estimated image signal to generate an 25 each group of vector coefficients to generate an estimate 

output comprised in part of signal independent noise com- signal. Of importance, the estimate signal as generated by 

ponents that are uncorre lated to the input signal. Upon closer vector predictor 604 has noise components that are uncor- 

inspection it will be appreciated by those skilled in the art related and non-linear ly dependent upon the input signal, 

that the primary differences between the teachings of FIGS. This dependence between the noise components and the 

6 and 7 are that FIG. 6 operates at the subband image level 30 input signal renders typical noise rejection techniques inef- 

while FIG. 7 operates at the image level. fective. Notwithstanding, substantial noise rejection 

With reference to FIG. 9, a block diagram of a commu- improvement could be achieved if the interdependence 

nications device 900 of the type anticipated for use by the between the estimate signal and the input signal were 

present invention is depicted. The communications device removed. To achieve this goal the present invention employs 

900 employs a transmitter 903 which operates to transmit 35 the prediction circuit 602 of FIG. 6 for generating signal 

signals received from peripheral device 902. For the purpose independent noise components that are uncorrelated to the 

of this discussion, let's assume device 903 is a document input signal. 

scanner like those known in the art. A receiver 907 couples From block 1012, flow proceeds to block 1014, where the 
received signals to peripheral device 908. For the purpose of estimate signal and with the plurality of image vector 
this discussion, let's assume device 908 is a display device, 40 coefficients are summed to generate an error signal. From 
such as, for example, a cathode ray tube (CRT), liquid block 1014 flow proceeds to block 1016 where the error 
crystal display (CRT), or any other type display device, now signal is compressed (quantized) by a mean square error 
know or later developed and capable of presenting graphical, (MSE) quantizer 606 of FIG. 6. In accordance with the 
pictorial, or text based messages to a device user 900. The preferred embodiment, the quantizer 606 is a vector quan- 
antenna 904 of the present invention is coupled to the 45 tizer. In particular, the vector quantizer of choice is a 
transmitter 907 and the receiver 907 through coupler 905. As Lloyd-Max quantizer, which, as previously mentioned, corn- 
will be appreciated, coupler 905 provides switched opera- presses the error signal to generate a quantized error signal, 
tions between transmitter 903 and receiver 907 under the At block 1018 the quantized error signal and the estimate 
direction of controller 906. signal are summed to generate signal independent noise 

As will be appreciated by those skilled in the art after 50 components that are uncorrelated to the input signal, such 

review hereof, the encoder 210 of FIG. 2, when used in that filtering becomes an viable noise rejection mechanism, 

association with the device 900 of FIG. 9, will typically be As will be appreciated by those skilled in the art after review 

used during transmit mode. In a similar fashion, the decoder hereof, filtering may be employed at either the encoder 210 

220 of FIG. 2, when used in association with the device 900, output, the decoder 220 output, or any point of advantage 

will typically be used during receipt. 55 thereinbetween. 

FIG. 10 is a flow chart diagram depicting the steps From block 1018, flow proceeds to block 1020 where a 

performed by a device 900 of FIG. 9 employing the com- code book index 216 of FIG. 2 is created for each of the 

pression methodology of the present invention. Commenc- centroids generated in accordance with block 1008 above, 

ing at start block 1000 flow proceeds to block 1002 where From block 1018, flow proceeds to block 1022 where the 

the communications device 900 of FIG. 9 receives a signal, 60 transmitter 902 of FIG. 9 transmits the index 216 and 

such as an image signal, from a peripheral device 902 in predictor matrix over the channel 230 of FIG. 2. 

anticipation of transmitting information from transmitter At block 1024, a communications device, such as the 

903. From block 1002, flow proceeds to block 1004 where device 900 of FIG. 9, receives the transmitted index and 

the information signal is transformed by a transform stage. predictor matrix information. At block 1026, the device 

In accordance with the preferred embodiment of the present 65 indexes the code book 225 of FIG. 2 with the received index 

invention, this transform stage is a frequency domain trans- information to retrieve predetermined centroid coefficients 

form. In particular, the transform associated with block 1004 stored to the code book. At block 1028 the predictor matrix 
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is applied to the retrieved predetermined centroid coeffi- 2H(* w i-<*»f>) 2 } f) 

cients to generate an output comprising modified code book From block nig flow proC eeds to block 1120 where the 

information. At block 1030 the modified code book infor- variance as calculated at block 1118 is stored. At block 1122 

mation is filtered utilizing filter 223 of FIG. 2. As described ; ^ incremented. Thereafter, at block 1124, a check is made 

hereinafter, filter 223 is an adaptive orientation wiener 5 to determine whether all masks under consideration have 

(AOW) filter that operates to remove the signal independent been app iied. If not, flow branches back to block 1114 where 

and uncorrelated noise from the retrieved code book value, a different mask is selected and the mean and variance are 

after application of the matrix. again ca i cu iat e d and stored for the pixel in question as 

From block 1030, flow proceeds to block 1032 where the differentiated by a second mask. This process continues until 

inverse wavelet transform operates on the filtered signal to 1Q al] masks in que stion have been used to generate means and 

reconstruct the original signal samples s'(n). While the variance data for the pixel in question, 

preferred embodiment suggests filtering the product output A f Ser all the masks of i nterest have been applied, flow 

of table lookup 224, it will be appreciated by those skilled proce eds from block 1124 to block 1126, where a minimum 

in the art, after review hereof, that filtering may alternatively variance value is selected. Said another way, at block 1126 

be performed after the quantization stage 214 as well as after a fi i ter mas k f rom among the plurality of filter masks is 

the inverse wavelet transformation stage 222. 15 selected. As will be appreciated by those skilled in the art, 

FIG. 11 is a flow diagram depicting the steps performed after review hereof, the filter mask exhibiting a minimum 

by filter 223 of FIG. 2 as mentioned in association with step variance output is typically a mask having a directional 

1030 of FIG. 10 to provide filtering in accordance with the orientation (e.g., horizontal, vertical, 45 degree, 135 degree) 

present invention. The filter of the present invention is a similar to the orientation exhibited by the group of image 

spatial domain uncorrelated Weiner or adaptive orientation 20 components being filtered. Thus, in accordance with the 

Weiner (AOW). The AOW of the present invention operates preferred embodiment, the filter 223 of FIG. 2 adaptively 

to process each pixel of the input image (g a,, n^ develop selects a filter mask from a plurality of available filter masks, 

a set of masks which when applied to the pixel will assist in Based, in part, upon similar or shared orientations between 

reducing noise variance and more clearly defining image tne mask and a g rou P of ima g e components. Of note, the 

e dg es 25 above process need not require that all available masks be 

In operation, the filtering commences at start block 1100 employed. It merely sets forth that some set of masks less 

when a code book output product is received by filter 223 of tha ° or c f*\ to , the set of avadable masks 15 satisfactory to 

FIG. 2. As will be appreciated the code book output com- P™toe ask, 

1 iv c an • * u az • » • • From block 1126, flow proceeds to block 1128 where a 

prises a plurality ot coerhcients, each coerncient comprising . , . r * . « , . . 

r . , * , . ■ vi localized noise variance as determined by the quantization 

signal component and a noise component. The noise circuil 214of FIG. 2., passed across the channel 230 of FIG. 

component comprises signal independent uncorrelated 2 and stored ifl mcmory ^ rctrievcd At block 1130 the 

noise. As will be appreciated from this continuing i ocahzed no ise variance is subtracted from the minimum 

discussion, the input to filter 223 is typically a subset of the variance to generate an estimated local variance, 

coefficients that comprise the entire image. From block At block 1132 a check is performed to determine whether 

1100, flow proceeds to block 1102 where a pixel counter Q p 35 the estimated localized variance is greater than a threshold, 

is set to zero. At block 1104 the pixel counter C p is If so, flow proceeds to block 1136, otherwise, flow proceeds 

incremented. At block 1106 a check is made to determine to block 1134 where the estimated localized variance is set 

whether all image pixels have been processed. If so, flow to zero and then flow proceeds to block 1136. At block 1136 

proceeds to block 1108 where the process flow terminates. a filtered pixel value can be estimated as a function of the 

Otherwise, flow proceeds from block 1106 to block 1110 40 estimated localized variance. As the image variance estimate 

where a mask length is selected. The mask length refers to improves over the noise level, the output value more closely 

a number of pixels around each pixel and is defined as 2p+l . resembles the original input. From block 1136 flow branches 

From block 1110, flow proceeds to block 1112 where the back to Dl <>ck 1104 where the pixel counter is incremented 

variable i is set to zero, 0. At block 1114, one of a plurality and the process is repeated. As will be appreciated by those 

of masks is generated. In accordance with the preferred 45 skiUed in the art, this process will continue until all pixels of 

embodiment, there are five to choose from; namely, the tne reconstructed image have been filtered. In accordance, 

square filter, represented by (2p+l) 2 with the pixel at the ^ A0W of ±& present invention performs image recon- 

center (n lt n^, the horizontal filter, with pixels (n 3 -p: nj+p, struction and filtering on a pixel-by-pixel basis with a mask 

n^, the vertical filter, with pixels (n lf n 2 -p: n 2 +p), and the len 8 th of ( 2 P +1 )- ^ ccntcr P ixel is associated with a 

45 degree filter, as well as the 135 degree filter. If we 50 specific centroid by the decoder and the value of the esti- 

consider the rectangular window g (rij-p: n A +p, n 2 -p: n 2 +p) matcd noise variance is obtained by quantizer 214 of FIG. 2 

of pixels as a matrix W (n lf n 2 ) of size (2p+l), the filter and P assed across the channel 23C for use during image 

processes either 1) the entire matrix with the square filter; 2) si S nal reconstruction and noise filtering as suggested herein, 

the central row with the horizontal filter; 3) the central ^ advantages of the present invention are several, 

column with the vertical filter; 4) the second main diagonal 55 Suffice it to say, however, the quantization circuit 214 of 

with the 45 degree filter; or 5) the main diagonal with the nG - 2 permits one to degrade the original image by select- 

135 degree filter. As will be appreciated by those skilled in m g fewer centroids over which to represent an original 

the art, the square filter is a low pass filter while the image, thereby reducing the size of the code book required 

directionally oriented filters are edge detectors filters. to practice image reconstruction. Reduction in code book 

From block 1114, flow proceeds to block 1116 where a 60 sizes typically equates to a faster image reconstruction 

mean is calculated for the pixel in question in accordance system. Since the present invention elects to deal with the 

with noise associated with compression, a recognizable improve- 



a 



<*<!>,> 5) 



ment in signal-to-noise is exhibited by this approach which 
operates to render noise generated during data compression 



From block 1118, flow proceeds to block 1220 where a 65 signal independent and uncorrelated from the input so that it 
variance is calculated for the pixel in question in accordance may be filtered without negatively impacting the original 



with: 



input. 
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Filtering, as taught by the present invention, is directed 
towards the removal of independent and uncorrelated noise 
components from the reconstructed signal In accordance, an 
adaptive filter selects a filter mask from a plurality of 
available filter masks. Mask selection is based, in part, upon 5 
a similar or shared orientation between the mask and a group 
of image components/coefficients within the reconstructed 
signal. Of note, image component processing is performed 
on a local (e.g., pixel-by-pixel or 2 pixel-by-2 pixel) basis as 
opposed to a global basis (e.g. across the entire image). 
Moreover, image component processing may be performed 
at either the subband signal or image signal level. The 
advantage over the known art is that the noise correlation 
does not become correlated with the input as masks are 
sequentially applied. 

For the sake of clarity, FIG. 12. is a pictorial representa- 15 
tion depicting original image reconstruction in accordance 
with the prior art. FIG. 13, by contrast, is a pictorial 
representation depicting original image reconstruction in 
accordance with the present invention. These two figures are 
presented so that a visual comparison can be made. 20 

While the preferred embodiments of the invention have 
been illustrated and described, it will be clear that the 
invention is not so limited. Numerous modifications, 
changes, variations, substitutions and equivalents will occur 
to those skilled in the art without departing from the spirit 2 s 
and scope of the present invention as defined by the 
appended claims. For example, in accordance with the 
anticipated operation, the filter 223 of the present invention 
will likely be implemented in a digital signal processor 
(DSP), microprocessor, micro-controller, or some other 3D 
computer logic circuit either currently available or later 
developed that is capable of performing the procedure of 
FIG. 11. It will therefore be appreciated by those skilled in 
the art that filter 223 is achievable as a hardware or firmware 
embodiment such as the one depicted in FIG. 14. 35 

With reference to FIG. 14, there is shown a plurality of 
filter masks 1401, each having a different orientation as 
described hereinabove. Each filter mask 1401 receives as an 
input a value P representing the mask length and a group of 
input signal coefficients g(n lt n 2 ), 1403. Selector 1402 oper- 40 
ates upon the filter mask outputs to select a filter that 
provides a minimum variance output. In operation, it will be 
appreciated that the mask which provides such a minimum 
variance output will have an orientation which is similar to 
the orientation exhibited by the input g(n ls a 2 ). In 45 
accordance, mask selection may be determined as a function 
of orientation as well as minimum variance. 

As depicted, the selector output 1408, which is a mini- 
mum variance value, is summed with the localized noise 
variance value 1405, generated during quantization by the 50 
quantizer 214 of FIG. 2 and stored to register 1404, to 
generate an estimated local variance value 1407. Thereafter, 
processor 1406 utilizes the appropriate inputs to generate the 
filtered output 1410 in accordance with block 1136 of FIG. 

55 

What is claimed is: 

1. A data compression encoder comprising: 
a first quantizer, for receiving an input signal having data 
and compressing the data to generate compressed data 
and signal dependent noise; 60 
a predictor, coupled to the first quantizer, for generating 
uncorrelated noise components generated by the first 
quantizer; and a second quantizer, coupled to the 
predictor, for quantizing a signal indicative of noise 
generated by the first quantizer, such that the encoder 65 
produces signal independent noise components that are 
uncorrelated to the input signal. 
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2. The encoder of claim 1 further comprising a filter for 
filtering the signal independent noise components that are 
uncorrelated to the input signal. 

3. The encoder of claim 1 further comprising a transform 
stage coupled to the quantizer. 

4. The encoder of claim 3 wherein the transform stage is 
a transform selected from the group consisting of frequency 
domain transforms, spatial domain transforms, and statisti- 
cal domain transforms. 

5. The encoder of claim 1 wherein the quantizer is a 
device selected from the group consisting of vector 
quantizers, scalar quantizers, trellis quantizers, and trunca- 
tion quantizers. 

6. The encoder of claim 1 wherein the predictor is a device 
selected from the group consisting of gain-plus-additive 
noise predictor, memory less predictor, high order, predictor, 
non-linear predictors, and predictors having memory. 

7. The encoder of claim 1 wherein the data is selected 
from the group of information consisting of: speech, audio, 
video, and still images. 

8. A data compression encoder comprising: 

a transform stage for receiving an input signal having data 
and providing a transformed output in response thereto; 

a first quantizer, coupled to the transform stage, for 
quantizing the transformed output, to generate com- 
pressed data and signal dependent noise; and 

a second quantizer, coupled to the first quantizer, for 
quantizing a signal indicative of noise generated by the 
first quantizer, 

such that the encoder produces signal independent noise 
components that are uncorrelated to the input signal. 

9. The encoder of claim 8, wherein the transform stage is 
selected from the group consisting of frequency domain 
transforms. 

10. The encoder of claim 8, wherein the transform stage 
does not transform all subbands within the input signal. 

11. The encoder of claim 8, wherein the first and second 
quantizers are means-squared quantizers selected from the 
group of consisting of: 

vector quantizers 
scalar quantizers; and 
trellis quantizers. 

12. The encoder of claim 8, further comprising a 
predictor, coupled between the first and second quantizers, 
for estimating noise components that are uncorrelated to the 
input signal. 

13. The encoder of claim 8 further comprising a filter for 
filtering noise components that are signal independent and 
uncorrelated to the input signal. 

14. A data compression encoder for use in slow rate signal 
processing comprising: 

a wavelet transform for receiving an input signal and 
providing a transformed output having vector coeffi- 
cients; 

a first quantizer, coupled to the wavelet transform, for 
selecting a group of vector coefficients to form a vector 
and quantizing the vector to generate compressed data 
and signal dependent noise; 

a predictor, coupled to the first quantizer, for estimating 
noise components generated by the first quantizer; and 

a second quantizer, coupled to the predictor and the first 
quantizer, for quantizing a signal indicative of noise 
components generated by the first quantizer, 

such that the encoder produces signal independent noise 
components that are uncorrelated to the input signal. 
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15. The encoder of claim 14, wherein the first and second 
quantizer are Lloyd-Max quantizers. 

16. The encoder of claim 14, wherein the predictor 
estimates quantization noise as a function of Y=X+E=AX+ 
R, where X is the input signal, Y is the quantized input 5 
signal, E is correlated quantized noise, R is uncorrected 
quantized noise, and A is a prediction matrix. 

17. The encoder of claim 14, wherein the first quantizer 
sizes groups of image vectors to enhance image reconstruc- 
tion quality. Q 

18. The encoder of claim 14, wherein the first quantizer 
sizes groups of image vectors so as to improve image 
reconstruction time. 

19. The encoder of claim 14, wherein the first quantizer 
sizes groups of image vectors so as to reduce image recon- J5 
struction cost. 

20. The encoder of claim 14, wherein the first quantizer 
alters a number of centroids required to represent the input 
signal by selecting a means-squared error tolerance. 

21. The encoder of claim 14, wherein the predictor 2Q 
predicts the noise components being uncorrected to the 
image signal as a function of quantization gain plus additive 
noise. 

22. The encoder of claim 14, further comprising a filter to 
remove signal independent noise components that are uncor- 25 
related to the input signal. 

23. A data compression system comprising: 
a transmitter; 

an image encoder coupled to the transmitter and having: 
a wavelet transform for receiving an image signal and 30 
providing a transformed output comprised of image 
vectors, 

a first vector quantizer, coupled to the wavelet 
transform, for adaptively sizing groups of image 
vectors and quantizing the image vectors within each 35 
group to establish a centroid for each group and an 
index for each centroid, 

a predictor, coupled to the first vector quantizer, for 
determining noise components generated by the first 
vector quantizer as a function of a prediction matrix, 40 
said noise components being uncorrelated to the 
image signal, and 

a second vector quantizer, coupled to the predictor and 
the first vector quantizer, for quantizing a signal 
indicative of noise components generated by the first 45 
vector quantizer, 
the transmitter communicating index and prediction 

matrix across a channel; and a receiver; 
an image decoder, coupled to the receiver, for receiving 

the index and the prediction matrix, the image decoder 50 

comprising: 

a table lookup for indexing centroid information with 
the index, 

an inverse wavelet transform, coupled to the table 
lookup, for reconstructing the image signal; and 55 

a filter, coupled to the inverse wavelet transform, for 
filtering signal independent noise components that 
are uncorrelated to the input signal. 

24. The system of claim 23, wherein the wavelet trans- 
form improves image signal compression by transforming 60 
select image signal subbands. 

25. The system of claim 23, wherein the first vector 
quantizer selects the size of image vector groups to enhance 
image reconstruction quality, improve image reconstruction 
speed, and reduce image reconstruction cost. 65 

26. The system of claim 23, wherein the channel is 
selected from the group media consisting of: 



wireless communications channels; 

optical communications channels; 

wireline communications channels; 

radio frequency (RF) communications channels; and 

storage media. 

27. The system of claim 23 wherein a quantizer obtains a 
local noise variance generated for each centroid centered. 

28. The system of claim 27 wherein the transmitter 
communicates local noise variances across the channel. 

29. A data compression method comprising the steps of: 
compressing an input signal having data to generate 

compressed data and signal depended noise; and 
processing the signal dependent noise to generate signal 

independent noise components that are uncorrelated to 

the input signal; 
wherein the step of processing the signal dependent noise 

comprises the steps of: 

applying estimated noise component to the compressed 
data to generate a signal comprised in part of noise 
components that are uncorrelated to and dependent 
upon the input signal; 

summing the signal comprised in part of noise com- 
ponents that are uncorrelated to and dependent upon 
the input image signal and the compressed version of 
the input signal to generate an error signal; 

compressing the error signal to generate signal inde- 
pendent noise components; and 

summing the signal comprised in part of noise com- 
ponents that are uncorrelated to and dependent upon 
the image signal with the signal independent noise 
components. 

30. A method for compressing an image signal comprising 
the steps of: 

receiving the image signal; 

transforming selective subbands of the image signal into 
a signal comprising a plurality of image coefficients; 

adaptively sizing groups of coefficients to form image 
vectors; 

compressing the image vectors within each group with a 
vector quantization compressor to establish a centroid 
for each group; 

estimating a compression noise as generated by the vector 
quantization compressor; 

applying the compression noise estimate to the centroid 
for each group to generate an estimate signal comprised 
in part of noise components, uncorrelated to and depen- 
dent upon the image signal and estimated code vector 
coefficients; 

summing the estimate signal and the plurality of image 

vectors to generate an error signal; 
quantizing the error signal to generate a quantized error 

signal; 

summing the quantized error signal and the estimate 
signal to generate an output comprised in part of signal 
independent noise components that are uncorrelated to 
the input signal; and 

filtering the signal independent noise components. 

31. The method of claim 30, wherein the step of trans- 
forming selective subbands of the image signal further 
comprises the step of: 

selecting image signal subbands as a function of an 

original image; and 
wavelet transforming the selected image signal subbands. 

32. The method of claim 30, wherein the step of trans- 
forming selective subbands of the image signal further 
comprises the step of: 
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omitting image signal subbands as a function of the 

original image; and 
wavelet transforming the selected image signal subbands, 

33. The method of claim 30, wherein the step of trans- 
forming selective subbands of the image signal further 5 
comprises the step of: 

selecting low frequency image signal subbands for quan- 
tization. 

34. The method of claim 30, wherein the step of adap- 
tively sizing groups of image coefficients further comprises 10 
the steps of: 

selecting a small group of image vector to enhance image 

reconstruction quality; and 
selecting a large group of image vectors to improve image 15 

reconstruction speed. 

35. The method of claim 30, wherein the step of adap- 
tively sizing groups of image coefficients further comprises 
the step of: 

adjusting the size of a group of image vectors to enhance 20 
image reconstruction quality, improve image recon- 
struction speed, and reduce image reconstruction cost. 

36. The method of claim 30, wherein the step of com- 
pressing the image vector within each group further com- 
prises the step of: 25 

selecting a code vector within a group; and 
performing a mean-squared-error calculation between the 
selected code vector and all other image vectors within 
the group to establish the centroid for the group. 

37. The method of claim 30, wherein the step of estimat- 30 
ing the compression noise further comprises the step of 
determining a predictor matrix. 

38. A method for compressing an image signal comprising 
the steps of: 

receiving the image signal and providing a transformed 
output thereof comprising a plurality of image coeffi- 
cients; 
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adaptively sizing groups of image coefficients to form 
vectors and compressing vectors within each group to 
establish a centroid for each group; 

determining a prediction matrix as a function of compres- 
sion noise; 

applying the prediction matrix to the centroid for each 

group to generate an estimate signal, 
summing the estimate signal with the transformed output 

to generate an error signal; 
compressing the error signal to generate a quantized error 

signal; 

summing the quantized error signal and the estimate 
signal to generate signal independent noise components 
that are uncorrected to the input signal, and modified 
centroid; 

generating a code index; 

communicating the code index and the predictor matrix 
across a channel; 

receiving the code index and the predictor matrix from the 
channel; 

indexing a lookup table via the code index to access a 
predetermined centroid; 

applying the predictor matrix to the predetermined cen- 
troid coefficients to generate an output; 

applying an inverse transform to the output to reconstruct 
the image signal; and 

adaptively filtering the image to generate a reconstructed 
image. 

39. The method of claim 38 further comprising the step of 
adaptively filtering the signal independent noise components 
that are uncorrected to the input signal. 

***** 
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